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We present the first search for CPT-violating effects in the mixing of B^ mesons using the full 
Run II data set with an integrated luminosity of 10.4 fb~^ of proton-antiproton collisions collected 
using the DO detector at the Fermilab Tevatron Collider. We measure the CPT-violating asymmetry 
in the decay 5° —^ as a function of celestial direction and sidereal phase. We find no evidence 

for CPT-violating effects and place limits on the direction and magnitude of flavor-dependent CPT- 
and Lorentz-invariance violating coupling coefficients. We find 95% confidence intervals of Aa^ < 
1.2 X 10“^^ GeV and (-0.8 < Aar - 0.396Aaz < 3.9) x 10"^® GeV. 

PACS numbers: ll.30.Cp, 13.20.He, 14.40.Nd 


Lorentz invariance requires that the description of a 
particle is independent of its direction of motion or boost 
velocity. The Standard Model Extension (SME) [T] pro¬ 
vides a framework for potential Lorentz and CPT invari¬ 
ance violation (CPTV), suggesting that such violations 
can occur at the Planck scale but still result in potentially 
observable effects at currently available collider energies. 
The process of neutral meson oscillations is described by 
a 2 X 2 effective Hamiltonian with mass eigenvalues of 
the propagating particles having very small differences 
between them that drive the oscillation probability. For 
the system, the fractional difference between the 

eigenvalues is of the order of 10“^^. Due to this, B^-B^ 
oscillations form an interferometric system that is very 
sensitive to small couplings between the valence quarks 
and a possible Lorentz-invariance violating field, making 
it an ideal place to search for new physics [ 2 ]. 

The measurement of the like-sign dimuon asymmetry 
by the DO Collaboration [S] shows evidence of anoma¬ 
lously large CP-violating effects. This is currently one of 
the few significant deviations from the standard model of 
particle physics. One of the interpretations of this effect 
could be a CPT-invariant CP violation (CPV) in neu¬ 
tral H-meson mixing. The propagating “light” (L) and 
“heavy” [H) mass eigenvalues of the B^-B^ system can 
be written as [4j: 

\Bsl) cx p0:^|i3O) + (1) 

\B,h) cx pV^s\B°) - qVl^s\B°). (2) 
If the complex parameter is zero, CPT is conserved 


and CPV is due to \q/p\ yf 1 so that the oscillation prob¬ 
ability P{B^ -T 5°) is different from P{Bg -T B^). An 
alternative interpretation is that the asymmetry could 
arise from T-invariant CPV in mixing where 

\q/p\ = 1 , but is non-zero so that the probability of 
non-oscillation or oscillation back to the original state 
P{B° B°) is different from P{B° -T B°). By inte¬ 
grating these two probabilities in time the asymmetry 
Acpt between B^ and 5° meson decays can be inves¬ 
tigated. It can be shown that the CPTV contributions 
to the 2x2 effective Hamiltonian governing os¬ 

cillations depend on the difference between the diagonal 
mass and decay rate terms [ 3 ]: 

_ (Mil — M 22 ) — |(rii — r22) ^ 

* — Arris+ iATs/‘2 Am^ —jArs/2’ 

( 3 ) 

where Aa^ is a four vector direction and magnitude 
in space-time characterizing Lorentz-invariance violation 
which in the SME is given by Aa^ = —where 

are Lorentz-violating coupling constants for the two va¬ 
lence quarks in the meson, and where the factors Vq al¬ 
low for quark-binding or other normalization effects. The 
four-velocity of the 5° meson is given by /3^ = 7 ( 1 ,/?), 
is the difference between the diagonal elements of 
the effective Hamiltonian, and the mass and decay rate 
differences of the mass eigenstates are Arris = 'mn — rriL, 
and Ars=rL-TH 0 . The small fractional values of 
Arris and AP^ make the 5° system sensitive to CPTV 
effects. In the underlying theory, spontaneous Lorentz 
symmetry breaking generates constant background ex- 
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pectation values for the quark fields that are Lorentz vec¬ 
tors represented by Aa^ or tensors instead of scalars [4] . 

Any observed CPT violation should vary in the frame 
of the detector denoted with indices {t,x,y,z). The pe¬ 
riod will be one sidereal day (~ 0.99727 solar days) as the 
direction of the proton beam follows the Earth’s rotation 
with respect to the distant stars [ 1 ] . In the SME the vari¬ 
ation would depend on CPT- and Lorentz-invariance vio¬ 
lation coupling coefficients Aa^ with indices (T, X, Y, Z). 
We choose (T, X, Y, Z) as coordinates in the standard 
Sun-centered frame with the rotation axis of the Earth 
taken as the Z-axis and X{Y) is at right ascension 0° 
(90°) [7] (see [ 8 ] for a diagram of the coordinate sys¬ 
tem). If CPTV in Bg-Bg oscillations is allowed, then 
^CPT = (ATOs/rs)Im(^s) if is small. By translating 
from the Sun-centered frame to the detector frame we 
have [ 1 ] 


—AT 

-Acpt ~ p — [Aar — CaSx/3^° Aaz 


+ ^ClCl + SI sin(m + (5 + k)/ 3™ Aa^j , (4) 


where = cos(a;), = sin(x), t is elapsed time 
with respect to the vernal equinox of the year 2000, 
n = 27r rad/sidereal day, = j5°° cos 9 is the veloc¬ 
ity /3 of the meson in the detector frame projected 
onto the z-axis (proton beam direction) of the DO detec¬ 
tor, 6 is the polar angle between the B^ momentum and 
the proton beam direction, 7 °° = 1 /-^! — (/ 3 no) 2 ^ ^ jg 
the colatitude of the DO detector, a is the orientation of 
the 0 -axis of the detector in the earth’s coordinate sys¬ 
tem, where the proton beam has a bearing of 219.53°, 
Aa± = \/Aa^ -I- Aoy is the transverse and Aaz the 
longitudinal components of Aa^, S = tan“^(AaY/Aax), 
K = {—Sa/CaCy^) and Aax is the time compo¬ 

nent of the Aa^ four-vector. A variation with side¬ 
real time could arise from the rotation of with re¬ 
spect to Ad. In this Letter we place limits on Aa_L and 
Aqt — CaS^I3°° Aaz ■ 

Past experiments and analyses have placed constraints 
on the flavor-dependent Aa^ in other neutral meson oscil¬ 
lating systems: K^-K^ [5], D^-D^ [TD], and B^-B^ E], 
as well as indirect limits for B'^-B'^ [S]. 

This article presents a search for CPT and Lorentz vio¬ 
lation using the decay B^ —>• iJ,'^D~X, where D~ —)• 
and (j) — >■ K'^K~ (charge conjugate states are assumed 
in this article). CP-violating asymmetries are usually be¬ 
tween “wrong-sign” decays B^ ^ B^ ^ /i+Dj, but we 
want to study the asymmetry between the “right-sign” 
decays B^ ^ B^ ^ D'^ and its charge conjugate. We 

extract the CPT-violating parameter using the asymme¬ 
try: 


A = 


N+ - N_ 
N+ + N_' 


( 5 ) 


where N+ [A_] is the number of reconstructed B^ —>■ 


fi^DfX events where sgn(cos 0)(5 > 0 [sgn(cos 0)(5 < 0 ] 
which results from the cos 6 terms in Eq. 

and Q is the charge of the muon. The direction of the 
system differs from that of the parent B° due to 
the missing neutrino. However, the migration between 
A_|_ and A_ terms near 6 = tt 12 causes a negligible cor¬ 
rection to the measured asymmetry. The initial state at 
production is not flavor tagged in our study, but after ex¬ 
perimental selection requirements, the B^ system is fully 
mixed, so that the probability of observing a or 5° 
is essentially equal regardless of the flavor at production. 
We assume no CP violation in mixing [T^] , so only about 
half of the observed B^ have the same flavor as they had 
at birth. We assume no CP violation, so those observed 
B^ mesons which have changed their flavor do not con¬ 
tribute to CPTV, leading to a 50% dilution in the mea¬ 
sured asymmetry. In the presence of CPT violation, the 
asymmetry is expected to have a period of one sidereal 
day, so a search is made for variations of the form 

A(t) = Ag — Ai sin(Df -I- 0), ( 6 ) 

where Ag, Ai and (j) = S + k are constants and are ex¬ 
tracted by measuring the asymmetry A in Eq. in bins 
of the sidereal phase fit, and fitting to the value in each 
bin with Eq. Measurements of Ag and Ai are then 
interpreted as limits on Aa^ from B^-B^ oscillations. A 
non-zero value of Aa^ and Aot would lead to a CPTV 
asymmetry that does not vary with sidereal time. 

The data selection and the signal extraction are iden¬ 
tical to those used in Ref. m- The main details of the 
data selection using the DO detector [14] are described 
here. 

The data are collected with a suite of single and 
dimuon triggers. The selection and reconstruction of 
yX D~ X decays require tracks with at least two hits in 
both the central fiber tracker and the silicon microstrip 
tracker. The muon track segment outside the calorimeter 
has to be matched to a particle found in the central track¬ 
ing system which has momentum p > 3 GeV and trans¬ 
verse momentum 2 < px < 25 GeV. The Dj 
(j) —t K^K~ decay is reconstructed by assuming the two 
(j) decay particles are kaons, requiring px > 0.7 GeV, op¬ 
posite charges, and M{K^K~) < 1.07 GeV. The charge 
of the third particle, assumed to be the charged pion, 
must have charge opposite to that of the muon and 
0.5 < px < 25 GeV. The three tracks are combined to 
create a common Dj decay vertex using the algorithm 
described in Ref. [15]. The reconstructed candi¬ 

date is required to pass several kinematic selection crite¬ 
ria and satisfy likelihood ratio criteria that are identical 
to those described in Ref. m- 

The effective K'^K mass distribution is fitted us¬ 
ing bins of 6 MeV over a range of 1.7 < M{K~^< 
2.3 GeV, and the number of signal and background events 
is extracted by a fit of an empirical model to the data. 
The Df meson mass distribution is well modeled by two 
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Gaussian functions constrained to have the same mean, 
but with different widths and normalizations. There 
is negligible peaking background under the Df peak. 
A second peak in the M{K^K~Tr^) distribution cor¬ 
responding to the Cabibbo-suppressed —>• (/)7r=*= de¬ 

cay is also modeled by two Gaussian functions with 
widths set to those of the Df meson model scaled by 
the ratio of the fitted and Df masses. The combi¬ 
natoric background is modeled by a S^^'-order polyno¬ 
mial function. Partially reconstructed decays such as 
Df —)■ (j)7r^TT^ where the 7r° is not reconstructed are 
modeled with a threshold function that extends to the 
Df mass after the 7r° mass has been subtracted, given 
by T{m) = tan“^ [pi(mc^ ~ P 2 )\ +P 3 , where pi are fit 
parameters. 

The raw asymmetry (Eq. is extracted by fitting the 
distribution of the candidates us¬ 

ing a minimization. The fit is performed simultane¬ 
ously, using the same models, on the sum and the differ¬ 
ence of the M{K'^K~Tr^) distribution of candidates 
and N- candidates. The functions used to model the two 
distributions are 

kPsum =Wd^ +Wd+ VPcb + kPpt, (7) 

VPdiff =AVPz5 , + AdWd + AebfEcb + AptVPpt, (8) 

where Wd,,Wd, kPcb, and Wpt describe the distribution 
of the Df and D^ mass peaks, the combinatorial back¬ 
ground, and the partially reconstructed events, respec¬ 
tively, and the A factors are the corresponding asymme¬ 
tries which are extracted from the fit. The number of 
signal events in the sample is N{Df) = 205,865 ± 626. 

Following previous conventions m we shift the ori¬ 
gin of the time coordinate to correspond to the vernal 
equinox of the year 2000. The value of Ai is extracted 
by dividing the data into n data sets, each containing a 
fraction fi of the data based on the sidereal phase fit -I- (p. 
In the fit, the parameters that describe the mass distri¬ 
butions kPsum and kPdiff are the same for all sidereal bins, 
except for A and Ao which may vary with sidereal phase. 

The number of sidereal bins used to extract the asym¬ 
metry is determined by finding the smallest uncertainty 
on Ai. By using MC input of asymmetries from 0% to 
2 % we find that the optimum number of bins is eleven. 
One of the eleven distributions produced in the fit to the 
data is shown in Fig. 

Systematic uncertainties of the fitting method on the 
extracted values of A in sidereal bin i, A{i), are evalu¬ 
ated by varying the fitting procedure and are assigned 
to be half of the maximal variation in the asymme¬ 
try. The mass range of the fit is shifted from 1.700 < 
M{K+K-tt^) < 2.300 GeV to 1.724 < M{K+K-tt^) < 
2.270 GeV in steps of 6 MeV resulting in an absolute un¬ 
certainty on the measured asymmetries of 0.035%. The 
width of the mass bins is changed between 1 and 12 MeV 
resulting in an absolute uncertainty of 0.071%. The func¬ 
tions modelling the signal are modified to fit the D^ 



FIG. 1. (a) The K^K~n^ invariant mass distribution for 
one of the 11 sidereal bins of the data (bin 5) of the 
sample. The lower mass peak is due to the decay —>■ 

and the second peak is due to the Dj meson decay, (b) The 
fit to the {N+ — N-) distribution for one of the 11 sidereal 
bins of the data (bin 5). 


and Df mass peaks by single Gaussian functions, the 
background is fitted by varying between a fourth- and 
seventh-order polynomial function, and the parameter pi 
in the threshold function is allowed to vary. As a test, the 
fraction of data in each sidereal bin, fi is fixed to exactly 
1/11. These variations of the signal modelling yield an 
absolute uncertainty on the asymmetry of 0.085%. The 
uncertainty for each of these sources is added in quadra¬ 
ture, to give the total systematic uncertainty of the fit¬ 
ting procedure of 0.12%. This uncertainty on the mea¬ 
sured values of A{i) is found to be independent of sidereal 
bin, and is added in quadrature to the statistical uncer¬ 
tainty to extract the GPT-violating parameters by fitting 
to Eq. 1^ (see Table |T]) . The measured values of the asym¬ 
metries, A{i), are plotted in Fig. and are tabulated in 
0 . 

The limits on Aa^ are extracted using: 


Ai sin(ll£ + (p) = 


^non-osc^rs(7D0/3D0) 

r.Am.s 


An =— 


X + SI sm{nt + 5 + K)Aai, ( 9 ) 

^non-oscAr^(7D0) 


TsAm. 


■[AaT-C^S^{P°°)Aaz], 

( 10 ) 


where angle brackets denote average values. The 
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Sidereal Phase 


FIG. 2. The measured asymmetries, A{i) versus sidereal 
phase. The uncertainty on each value of A{i) is the sum 
in quadrature of the statistical and systematic uncertainties. 
The red boxes show the fit and its uncertainties to the data 
points (Eq. 1^. The dashed line shows the extracted value of 
Aq and the grey box shows A^Iq. 


factor is the fraction of Df —>■ decays for which an 

observed 5° has the same flavor as at birth m- Combin¬ 
ing the fraction of decays in the sample and the 50% 
dilution factor described earlier gives = 0.465. 

Limits are extracted from the probability distribution 
which is given by exp(—y^/ 2 ) where is the chi-square 
as a function of Ai , Aq and <5 using Eq. Since we are 
setting limits, the probability distribution will be char¬ 
acterized by two quantities, the most probable value of 
Ai and the 95% upper limit (UL) which is extracted by 
integrating the normalized probability distribution at the 
value of 5 that gives the most conservative limit. 

To extract limits, we measure the average values 
of ( 700 ) = {EBo)/mBO, = {pz)/{Ebo) and 

(^DOyjDo) = {pz)jmB0 where (pz) is the average momen¬ 
tum in the z-direction and (Ego) is the average energy of 
the Bg meson. The average momentum of the pDf can¬ 
didates is measured using sideband subtraction. The sig¬ 
nal region is 1.92 < < 2.00 GeV and the 

sideband regions are 1.75 < M{K^K~-k~) < 1.79 GeV 
and 2.13 < M{K'^K~tt~) < 2.17 GeV, and the average 
is {p) = 21.41 ± 0.03 GeV. This momentum needs to be 
corrected for the missing neutrino in the decay using a k- 
factor correction. These fc-factors are taken from Ref. m 
and applied to give a momentum of (p) = 25.3 GeV. 
The systematic uncertainty on (p) of 1.6 GeV is obtained 
from the difference between the momentum extracted us¬ 
ing sideband subtraction and using a weighted average of 
the number of signal events in momentum bins which is 
then added in quadrature to the uncertainty due to the 
fc-factors. The effect of possible reconstruction variations 
in the x and y directions are found to be less than 1 %. 
If we vary the number of sidereal bins the most probable 
value of Ai varies by 8 %. These variations are added in 


quadrature as the relative systematic uncertainty on the 
value of Ai. 

The final results are obtained by scaling the probabil¬ 
ity distributions obtained for Ag, Ai with the multiplica¬ 
tive factors given in Table |T] The systematic uncertain¬ 
ties on the multiplicative factors, the number of sidereal 
bins, and reconstruction effects are included by convolut- 
ing the probability distribution with a Gaussian function 
with the width given by the sum in quadrature of the sys¬ 
tematic uncertainties. We obtain a 95% upper limit (UL) 
of Aa_L < 1.2 X 10“^^ GeV. The most probable values of 
(5 and Aaj, are S = 4.901 and Aaj_ = 5.7 x 10“^^ GeV. 

TABLE I. Parameters and uncertainties in the extraction of 
the CPT-violating parameters. The uncertainties on Ao, Ai 
and (f) are fit uncertainties and are dominated by the statistical 
uncertainty of the raw asymmetries. All other uncertainties 
are systematic. 


Parameter 

Value 

Ref. 

^0 

(-0.40 ±0.31)% 

Eq. 

6 

Ai 

(0.87 ±0.45)% 

Eq. 

B 


-2.28 ±0.51 

Eq. 

B 

mgo 

(5.36677 ±0.00024) GeV 

m 


Arris 

(17.761 ± 0.022) x 10^^ 

m 


ATs/Ts 

(0.138 ±0.012) 

m 


rpnon-osc j-tosc 

^bo - ^bo 

(0.465 ±0.017) 




(17.8 ± 1.6) GeV 



Ip) 

(25.3 ±2.3) GeV 



Proton beam dir" a 

219.53° 



Colatitude y 

48.17° 




The limit on Aot —C'o,S'^/3j“ Aa^ is obtained from a fit 
to the asymmetries using Eq. This results in a value 
of Aq = (—0.40 ± 0.31)%. In this case the systematic 
uncertainties on the measured values of A{i) are assumed 
to be 100 % correlated between sidereal bins to obtain the 
most conservative limits and are added to the statistical 
uncertainty obtained from the fit. Using Eq. 10, we 
obtain Aar — CaS^P°° Aaz = AaT — 0.396Aaz = (1.5± 
1.2) X 10“^^ GeV resulting in a two sided 95% confidence 
interval (—0.8 < Aar — 0.396Aaz < 3.9) x 10“^^ GeV. 

We did a cross check using the periodogram method¬ 
ology [H] which sees no anomalous behavior for the fre¬ 
quency 1 /sidereal day [5]. 

For GPTV to explain the difference between the like- 
sign dimuon asymmetry [3] and the SM requires that 
(Aar — 0.396Aaz) to be of the order of 10“^^ GeV [5]. 
These limits imply that CPT violation is unlikely to 
contribute a significant fraction of the observed dimuon 
charge asymmetry, and that other explanations need to 
be sought. 

In conclusion, we have carried out the first search for 
CPT-violating effects exclusively in the B'^-B'^ oscilla¬ 
tion system via semileptonic decays of the B^ mesons. 
We find no significant evidence for CPT-violating effects 
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and place limits on the size of the Lorentz violating ef¬ 
fects, Aa^. These limits constrain a linear combination 
of the Lorentz-violating coupling constants a® for the b 
and s valence quarks in the meson that are differ¬ 
ent from the linear combinations of valence quarks in the 
5° [TT] or [3] mesons, and therefore further constrain 
the possible separate values of the three coefficients 
af,, and af.. We find 95% confidence intervals for the 
flavor-dependent coefficients Aa± < 1.2 x 10“^^ GeV and 
(-0.8 < Aar - 0.396Aaz < 3.9) x GeV. 
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AUXILIARY MATERIAL 


PERIODOGRAM ANALYSIS 


To appear as an Electronic Physics Auxiliary 
Publication (EPAPS) 


COORDINATE SYSTEM 

We choose {T, X,Y, Z) as coordinates in the standard 
Sun-centered frame with T being the time coordinate, the 
rotation axis of the Earth taken as the choice for the Z- 
axis and X{Y) is at right ascension 0° (90°) (c.f. Ref. [7] 
of the paper). This coordinate system is illustrated in 
Fig.i 


MEASURED ASYMMETRIES 


The measured asymmetries, A{i), used to extract the 
limits are given in Table 


TABLE II. The measured asymmetries, A{i) versus sidereal 
phase. The uncertainty on each value of A{i) is the sum in 
quadrature of the statistical and systematic uncertainties. 


Asymmetry 

Sidereal Phase 

Value (%) 


0-> (27I-)/11 

4-0.74 ± 1.03 

A(2) 

2(27T)jll 

4-0.15 ± 1.03 

A{3) 

2(27r)/ll->. 3(27r)/ll 

-0.20 ± 1.02 

A(i) 

3(27I-)/11->. 4(27r)/ll 

4-0.23 ± 1.01 

A{5) 

4(27r)/ll-i- 5(27r)/ll 

-0.86 ± 1.02 

A(6) 

5(27I-)/11-5. 6(27r)/ll 

-1.14 ± 1.02 

A(7) 

6(27I-)/11->. 7(27r)/ll 

-0.45 ± 1.02 

A(8) 

7(27i-)/ll-i- 8(27r)/ll 

-1.93 ± 1.03 

A(9) 

8(27I-)/11->. 9(27r)/ll 

-0.55 ± 1.03 

A(10) 

9(27r)/ll->. 10(2ir)/ll 

-1.11 4: 1.03 

A(ll) 

10(27I-)/11->. (271-) 

4-0.68 ± 1.03 


As a cross check to fitting the data for a periodic sig¬ 
nal, we also use the periodogram [18] method to measure 
the spectral power of a signal over a large range of fre¬ 
quencies. The spectral power at a test frequency v is 


PH 


N 

^ Wj exp i^—2-Kii'tj) 


Nal 


2 


( 11 ) 


where the data has N measurements each of weight 
Wj where the weight is the probability that the event 
is a signal event with a variance The weight for 
each event depends on QjCOsOj, and M{K^K~H) for 
the event and is based on the fit to Eq. 7: wj — 
Qj cos Oj Wd, [M{K+K-Tr ^)] /lEsum [M( A:+A- 7r±)]. In 
the absence of an oscillatory signal, the probability that 
P(v) at frequency v would exceed an observed value S is 
P{v) > S = exp(—S'). 

The spectral power of this data sample is 
P(one sidereal day) = 0.65. The probability of ob¬ 
taining a value of P greater than this is 52% which is 
consistent with no signal. The spectral power values 
for periods from 0.5 to 1.5 solar days in steps of 1 solar 
day/1000 are shown in Fig. Sixty percent of these 
measurements are greater than the spectral power at 
one sidereal day. The 95% UL is obtained by injecting 
simulated signals into the data and determining the 
probability distribution of the spectral power as a 
function of the injected signal Ai. The resulting 95% 
UL on Ai is 1.03%. This converts to a 95% UL of 
Aa_L < 6.9 X 10“^^ GeV which is comparable to that 
obtained from the analysis of the amplitudes. 
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FIG. 3. Illustrations of the coordinate systems used in this analysis, (a) The small rectangle represents the position of the DO 
detector on the earth, (b) Orbit of Earth in Sun-based frame (based on Fig. 1 from Ref. [7]). 
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FIG. 4. The periodogram for the data sample over the range of 0.5 days to 1.5 days in steps of (1 day/1000). The red star 
indicates the spectral power calculated at one sidereal day. 
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